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DETAILED ACTION 
Claim Rejections • 35 USC § 103 

1. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 30, 32-36, 38, and 40 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Hinoue in view of Rosenburg et al. (US 6,429,846) (hereafter, 
“Rosenburg”). 

Regarding claim Hinoue teaches an information input/output apparatus (Fig. 1) 
for controlling an operation of a target apparatus (Fig. 7) on the basis of a user 
authentication result associated with a user who operates the target apparatus (see col. 
5, lines 23-26, where the fingerprint verification is the user authentication result), 
comprising: a menu presentation unit configured to present a list of a plurality of menu 
items used to execute an operation of the target apparatus (Fig 7, where the number 
pad displayed is a menu of items used to execute an operation of the apparatus 71); a 
haptic information acquisition unit (Fig. 1, unit 34) configured to acquire haptic 
information of the user (see col. 9, lines 52-64, where the fingerprint information here is 
haptic information because it is only read upon the user’s touching of the screen) on the 
basis of a position of the menu item that the user touches with a finger of the plurality of 
menu items presented by said menu presentation unit (see col. 8, lines 6-23, where the 
device acquires the fingerprint information and the coordinate of the keypad number 
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touched, therefore it is on the basis of a position of the menu item); a user 
authentication unit (Fig. 1, fingerprint verification section 42) configured to authenticate 
the user on the basis of the haptic information acquired by said haptic information 
acquisition unit (Fig. 1, where fingerprint verification section 42 is authenticating the 
user’s fingerprint data based on the fingerprint data, which as discussed above is haptic 
information); 

However, Hinoue does not teach a haptic information output unit configured to 
output information perceivable by the user upon user’s touching the haptic information 
output unit with the finger and arranged at the position of the plurality of menu items. 

However, Rosenberg does teach a haptic information output unit configured to 
output information perceivable by the user upon user’s touching the haptic information 
output unit with the finger and arranged at the position of the plurality of menu items 
(see col. 2, lines 41 - 53, where the menu items are outputted as haptic information 
since a pulse can be output as the user moves between menu elements; and see col. 2, 
lines 41-44, where the haptic sensations mentioned are felt by a user’s finger). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to incorporate the teaching of Rosenburg in the device of Hinoue 
by incorporating the haptic output elements of Rosenburg into the touch screen of 
Hinoue, where the motivation to combine was to provide haptic output sensations to the 
user to indicate an event occurring on the display. 
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Regarding claims 32, 38, and 40, Hinoue teaches a haptic information input unit, 
method, and computer program (see col. 8, lines 53-54) configured to acquire a user's 
fingerprint on the basis of a position of the menu item touched by the user of the 
plurality of menu items output by said haptic information unit (Fig. 7, see col. 8, lines 6- 
23, where the device acquires the fingerprint information and the coordinate of the 
keypad number touched, and where the number pad displayed is a menu of items used 
to operate the apparatus 71); and user information processor (Fig. 1, CPU 32) 
configured to acquire a user's intention and authenticate the user on the basis of the 
user's fingerprint acquired by said haptic information input unit (see col. 10, lines 9-21, 
where a user’s intention is obtained detecting the location on the screen that the user 
intended to touch). 

However, Hinoue does not teach a haptic information output unit configured to 
output a plurality of menu items required for the user to execute an operation of a target 
apparatus as haptic information at the position of the plurality of menu items in a state 
that allows the user to recognize information contents thereof upon user's touching the 
information with a finger and arranged at the position of the plurality of menu items. 

However, Rosenburg does teach a haptic information output unit configured to 
output a plurality of menu items (see col. 2, lines 41 - 53, where the menu items are 
outputted as haptic information since a pulse can be output as the user moves between 
menu elements) required for the user to execute an operation of a target apparatus as 
haptic information at the position of the plurality of menu items in a state that allows the 
user to recognize information contents thereof upon user's touching the information with 
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a finger and arranged at the position of the plurality of menu items, (see col. 2, lines 41- 
44, where the haptic sensations mentioned are felt by a user’s finger). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to incorporate the teaching of Rosenburg in the device of Hinoue 
by incorporating the haptic output elements of Rosenburg into the touch screen of 
Hinoue, where the motivation to combine was to provide haptic output sensations to the 
user to indicate an event occurring on the display. 

Regarding claim 33, Hinoue in view of Rosenburg teaches the limitations of claim 
32 as discussed above, and Rosenburg further teaches a recognition result output unit 
(Fig. 1 , touchpad 16) configured to inform the user of information indicating whether or 
not the target apparatus has recognized the user's intention acquired by said user 
information processor (see col. 2, lines 41 — 53, where the user moves between menu 
elements a pulse can be outputted, therefore if it is user’s intention to move over a 
specific menu element then this intention will be recognized). 

Regarding claim 34, Hinoue in view of Rosenburg teach the limitations of claim 
31 as discussed above, and Rosenburg further teaches a haptic information output by 
said haptic information output unit is information perceived by the user as at least one 
physical quantity of a three-dimensional pattern, electricity, and calorific value at 
respective positions of the plurality of menu items (see col. 5, lines 10-14). 
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Regarding claim 35, Hinoue further teaches an apparatus wherein the user is 
authenticated on the basis of fingerprint information of the user (Fig. 1 , fingerprint 
verification section 42), which is detected from a distribution of at least one physical 
quantity of a pressure and calorific value produced by the finger of the user (see col. 9, 
lines 52-64, where the fingerprint information here only read upon the user’s touching of 
the screen, which indicates that a threshold quantity of pressure is being detected). 

Regarding claim 36, Hinoue in view of Rosenburg teach the limitations of claim 
31 as discussed above, and Rosenburg further teaches an image display (Fig. 1, 
display 12) configured to visually display predetermined image information, and wherein 
both the image information displayed on said image display, and the haptic information 
output by said haptic information output unit are presented to the user (Fig. 1 , touchpad 
16, see col. 5, lines 10-14, where the haptic information is presented to user while the 
image information is also presented to the user). 



3. Claims 42 and 43 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Hinoue in view of Rosenberg, and further in view of Liu et al. (US 5,804,462) 
(Hereafter, “Liu”) and further in view of Yu (US 2004/0025029). 

Regarding claim 42, Hinoue teaches an information input/output apparatus for 
controlling an operation of a target apparatus (Fig. 7) on the basis of a user 
authentication result associated with a user who operates the target apparatus (see col. 
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5, lines 23-26, where the fingerprint verification is the user authentication result), 
comprising: a menu presentation unit configured to present a list of a plurality of menu 
items used to execute an operation of the target apparatus (Fig 7, where the number 
pad displayed is a menu of items used to operate the apparatus 71); a haptic 
information acquisition unit (Fig. 1, unit 34) acquire haptic information of the user (see 
col. 9, lines 52-64, where the fingerprint information here is haptic information because 
it is only read upon the user’s touching of the screen) on the basis of a position of the 
menu item that the user touches with a finger of the plurality of menu items presented 
by said menu presentation unit (see col. 8, lines 6-23, where the device acquires the 
fingerprint information and the coordinate of the keypad number touched); and a user 
authentication unit (Fig. 1 , fingerprint verification section 42) authenticate the user on 
the basis of the haptic information acquired by said haptic information acquisition unit 
(Fig. 1 , where fingerprint verification section 42 is authenticating the user’s fingerprint 
data based on the fingerprint data, which as discussed above is haptic information). 

Hinoue further teaches a haptic information element having a haptic information 
unit (Fig. 7) corresponding to one kind of haptic information (see col. 9, lines 52-60, 
where the apparatus can detect the pressure corresponding to a user touching the 
screen) and each haptic information unit includes a first function unit configured to 
detect corresponding haptic information (see col. 9, lines 52-60, where the apparatus is 
configured to detect the pressure corresponding to a user touching the screen), and a 
second function unit reproduce some or all pieces of detected haptic information (see 
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col. 9, lines 52-60, where reproducing is the same as sending the detected haptic 
information to the central processing unit). 

However, Hinoue does not teach a third function unit configured to output 
information perceivable by the user and a haptic information element having haptic 
information units corresponding to a plurality of different kinds of haptic information. 

However, Rosenberg does teach a function unit configured to output information 
perceivable by the user (see col. 2, lines 41-53, where the haptic sensations mentioned 
are felt by a user’s finger). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to incorporate the teaching of Rosenberg in the device of Hinoue 
by incorporating the haptic output elements of Rosenberg into the touch screen of 
Hinoue, where the motivation to combine was to provide haptic output sensations to the 
user to indicate an event occurring on the display. 

However, Hinoue in view of Rosenberg does not teach a haptic information 
element having haptic information units corresponding to a plurality of different kinds of 
haptic information. 

However, Liu does teach a multiple sensor semiconductor chip having haptic 
information units (Fig. 5, sensor 10) corresponding to a plurality of different kinds of 
haptic information (see col. 5, lines 19-23). However Liu does not teach using a 
semiconductor chip for a fingerprint reader. 

However, Yu does teach using a semiconductor for a fingerprint reading device 



(see para. 23). 
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Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to incorporate the teachings of Rosenberg, Yu, and Liu in the touch 
screen of Hinoue in view of Rosenberg, where the motivation to combine was to detect 
multiple kinds of haptic information on the same device. 



Regarding claim 43, Hinoue teaches an information input/output apparatus for 
controlling an operation of a target apparatus (Fig. 7) on the basis of a user 
authentication result associated with a user who operates the target apparatus (see col. 
5, lines 23-26, where the fingerprint verification is the user authentication result), 
comprising: a menu presentation unit configured to present a list of a plurality of menu 
items used to operate the target apparatus (Fig 7, where the number pad displayed is a 
menu of items used to operate the apparatus 71); a haptic information acquisition unit 
(Fig. 1, unit 34) acquire haptic information of the user (see col. 9, lines 52-64, where the 
fingerprint information here is haptic information because it is only read upon the user’s 
touching of the screen) on the basis of a position of the menu item that the user touches 
with a finger of the plurality of menu items presented by said menu presentation unit 
(see col. 8, lines 6-23, where the device acquires the fingerprint information and the 
coordinate of the keypad number touched); and a user authentication unit (Fig. 1 , 
fingerprint verification section 42) authenticate the user on the basis of the haptic 
information acquired by said haptic information acquisition unit (Fig. 1, where fingerprint 
verification section 42 is authenticating the user’s fingerprint data based on the 
fingerprint data, which as discussed above is haptic information). 
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However, Hinoue does not teach a haptic information output unit configured to 
output information perceivable by the user upon user’s touching the haptic information 
output unit with the finger and arranged at the position of the plurality of menu items. 

However, Rosenberg does teach a haptic information output unit configured to 
output information perceivable by the user upon user’s touching the haptic information 
output unit with the finger and arranged at the position of the plurality of menu items 
(see col. 2, lines 41 - 53, where the menu items are outputted as haptic information 
since a pulse can be output as the user moves between menu elements; and see col. 2, 
lines 41-44, where the haptic sensations mentioned are felt by a user’s finger). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to incorporate the teaching of Rosenburg in the device of Hinoue 
by incorporating the haptic output elements of Rosenburg into the touch screen of 
Hinoue, where the motivation to combine was to provide haptic output sensations to the 
user to indicate an event occurring on the display. 

However, Hinoue in view of Rosenberg does not teach a haptic information 
acquisition unit comprising a substrate, a metal oxide layer formed on the substrate, and 
an electrode, and detects a plurality of different kinds of information by electrodes 
formed on a plurality of portions obtained by dividing the metal oxide layer. 

However Liu does teach a haptic information acquisition unit comprising a 
substrate (Fig. 4, substrate 16), a metal oxide layer formed on the substrate (Fig. 4, 
layer 36, see col. 3, line 60), and an electrode (Fig. 4, layer 34, see col. 3, lines 10-11), 
and detects a plurality of different kinds of information (see col. 5, lines 19-25) by 




Application/Control Number: 10/647,412 
Art Unit: 2629 



Page 1 1 



electrodes formed on a plurality of portions obtained by dividing the metal oxide layer 
(Fig. 4, and see col. 5, lines 19-25, where the metal oxide layer 36 is divided here, and 
will also be divided when multiple sensors are placed on the same chip). However Liu 
does not teach using a semiconductor chip for a fingerprint reader. 

However, Yu does teach using a semiconductor for a fingerprint reading device 
(see para. 23). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to incorporate the teachings of Liu and Yu in the touch screen of 
Hinoue in view of Rosenberg, where the motivation to combine was to detect multiple 
kinds of haptic information on the same device. 

Response to Arguments 

4. Applicant's arguments filed June 13, 2006 have been fully considered but they 
are not fully persuasive. 

Regarding Applicant’s arguments on page 12, pertaining to the examiner’s 
rejection of claims 30-31 and 34-36 under 35 U.S.C. 112, the examiner has withdrawn 
the rejection. 

Regarding Applicant’s arguments on page 14 that Hinoue does not teach 
performing an authentication based on the haptic information every time the user 
touches the menu items, the examiner responds that such a limitation is not clearly 
being claimed. 
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Regarding Applicant’s arguments on page 14 that it is not believed that Hinoue 
teaches or suggests an arrangement in which both the performing of an authentication 
based on haptic information and the executing of an operation of a target apparatus 
occur upon user’s touching a menu of items, the examiner respectfully disagrees. First, 
the applicant has not recited “both performing of an authentication based on haptic 
information and the executing of an operation of a target apparatus occur upon user’s 
touching a menu of items” in claim 30. Furthermore, Hinoue teaches (col. 8, lines 18- 
23, and col. 10, lines 64-67 to col. 1 1 , line 1) a device that both performs an 
authentication based on haptic information, which is the reading of the fingerprints, and 
the executing of an operation of a target apparatus, which is registering the number on 
the touchpad, upon user’s touching a menu of items. Therefore, Examiner believes that 
the prior art fairly reads on the claimed limitations. 



Conclusion 

5. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
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shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Sameer K. Gokhale whose telephone number is (571) 
272-5553. The examiner can normally be reached on M-F 8:00 AM - 4:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner’s 
supervisor, Amr Awad can be reached on (571) 272-7764. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 

Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

SKG Sameer Gokhale 

September 29, 2006 Examiner 
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